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1 Introduction 



In this paper we consider a controlled decoupled forward-backward stochastic differential 
system of the type 

dXf = b{X'^,Us)ds + a{Xf,Us)dWs, 
dY^ = y/, us)ds + Z^dW, + dM^, s G [t, T] , 

(M",w^), = 0, se [t,r], 

= x,Y^ = ^{XJf),Mf = 0, 

where, on a given filtered probability space (O,^, P, F), is a d-dimensional Brownian 
motion with respect to the not necessarily Brownian filtration F, X",y",Z" are square 
integrable adapted processes and M" a square integrable martingale that is orthogonal to 
W . The control problem consists in minimizing the cost functional over all adapted 
control processes u taking their values in a fixed compact metric space U : 

= essinf^y^". (2) 

If the driver / of the backward stochastic differential equation (BSDE) doesn't depend on 
(y, z) the cost functional takes the particular form 



^{X^) + f{X^,Us)ds I J^t 



(3) 



reducing the above control problem to the classical one, which has been well studied by a lot 
of authors; the reader is referred, for instance, to the book [7] of Fleming and Soner and the 
references therein. This classical stochastic control problem and its relation with Hamilton- 
Jacobi-Bellman equations has been generalized by Peng in pT]: He characterizes the value 
function V{t, x) of the stochastic control problem ([2]) as the unique viscosity solution of 
the associated Hamilton-Jacobi-Bellman equation (the reader is also referred to [13] for an 
approach based on BSDE methods). Moreover, in |12j he derives a necessary condition for 
the optimality of a stochastic control for ([2]), given in form of a maximum principle. At the 
same period, motivated by applications in econometrics and mathematical finance, Duffie 
and Epstein have introduced in p] a similar cost function called "recursive utility"; their 
cost functional Y^ corresponds to the solution of the above BSDE in (1) if the driver / is 
supposed not to depend on z. For further contributions concerning this stochastic control 
problem and its applications the reader is referred to [6], [1], [13], [1] and the references 
cited therein. 

The objective of our present work is to investigate the question of the existence of an 
optimal control for the problem In the case of a usual stochastic control problem with 



2 



classical cost functionals ([3]) it is well known that, in general, the existence of an optimal 
control can be got only in the larger class of relaxed controls. However, by El Karoui, 
Nguyen and Jeanblanc [5j and by Haussmann and Lepeltier [8j it has been proved that 
an optimal control in the original "strong" sense exists under some convexity assumptions. 
We prove an analogous result for the more general case of the controlled forward-backward 
system of type ([T]). For this, we approximate ([I]) by a sequence of stochastic control systems 
{5) with smooth coefficients. Since the Hamilton-Jacobi-Bellman equation associated with 
a stochastic control system with smooth coefficients and strictly elliptic diffusion coefficient 
admits a smooth solution, it is possible to determine explicitly an optimal feedback control 

by applying a verification theorem. We prove that the value functions of these ap- 
proximating systems converge to the value function V of the original problem ([2]). Further, 
the solution {X^ , Z^) of the approximating control system with the optimal feedback 
control can be approached by a sequence of simple forward equations satisfied by some 
couple {X^ ,Y^) and depending on a couple of bounded controls {Z^,u^). This point of 
view enables us to apply the well known theory of stochastic controlled forward-systems: 
We claim that the sequence {X^ , Y^) converges in law to some couple {X, Y), at least along 
a subsequence, and that this couple satisfies a stochastic differential equation depending on 
a relaxed control, that is optimal for Finally, under a suitable convexity assumption 
generalizing that of El Karoui, Nguyen and Jeanblanc [5j, we deduce that this optimum is 
also attaint by a control in the "strong sense", i.e., an admissible control process u defined 
on an appropriate reference stochastic system {i},J^,P,¥,W). Moreover, we discuss our 
convexity condition and compare it with that of [S]. 

Our paper is organized as follows: In Section 2, we state the problem and give the main 
result. Moreover we introduce necessary notations and recall known results which will be 
used in what follows. Section 3 is devoted to the study of the approximating control problem 
and the associated Hamilton-Jacobi-Bellman equation: we prove that for the approximating 
control problem (5) the essential infimum of the cost functionals is attained by a feedback 
control , and that the value function V^{t,x) converges to V{t,x). Finally, in Section 4, 
we prove our main result concerning the convergence in law of the couples {X^,Y^) along 
some subsequence (5 \ 0, and the existence of an optimal control of ^ under an appropriate 
convexity assumption. Finally, our convexity condition is compared with that of [5j. 
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2 Notations, preliminaries and main theorem 

Let T > be a finite time horizon and U a compact metric space. We call a reference 
stochastic system complete probability space {Q^,J-^,P^) endowed with a filtration 
F'^ satisfying the usual assumptions (i.e. F'^ is right-continuous and contains all P'^-null 
sets in T) and, according to our needs, with one or two independent d-dimensional Brow- 
nian motions: = (Q^ , , P'^ ,W^) or i^^ = {Q'^ , , , B^). This reference 

stochastic system will vary all along this work. On v^, we now introduce the following 
spaces of processes: 

For all dimension m E N* and any t E [0,T], 

• S^o{t,T;W^) will denote the set of M'^-valued, F'^-adapted, continuous processes 
{^s,s E [t,T]) that satisfy £;[supt<5<T I^sl^] < oo, 

• nlo{t,T;R"') is the set of M™-valued, FO-predictable processes (^'^,5 E [t,T]) that 
satisfy E[J^ l^'spds] < oo, 

• M'^oit,T;R"') denotes the set of all M'"-valued, square integrable cadlag martingales 

M = {Ms)se[t,T] with respect to F°, with Mt = 0, 

• lAjjo{t) denotes the set of admissible controls, i.e. the set of F'^-progressively measurable 
processes {us-,s E [t-,T]) with values in U. 

Let us now fix some initial reference stochastic system v = [Vl,!F,P,¥,W). For any initial 
condition E [0, T] x M*^ and any admissible control u := {us,s E [t^T]) E U,y{t), we 

consider the following decoupled forward-backward stochastic differential system: 
/■ 

dXs = b{Xs,Us)ds + a{Xs,Us)dWs, 

dYs = -f{X„Ys, Z„us)ds + ZsdWs + dMs, s E [t, T], 

Xt = x,YT = HXT),Mt = 0, (M, W) = 0, 

{X,Y,Z,M) E S^{t,T;R'^) x S^{t,T;R) x n^{t,T;R'^) x Ml{t,T;R'^), 

where 

b : R'^ X U ^ R"^, a : R"^ X U ^ M'^^'^, / : M'=' x M x M'^ x ^7 ^ M and $ : M'^ ^ M 
satisfy the following assumptions (see, e.g., [1] or [2]): 

1. • b and a are bounded by some constant M > 0, 

• for all X E R'^, b{x, •) and a{x, •) are continuous in u E C/, 
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• there exists some C > 0, such that, for all x,x' G and v £U, 

\b{x, v) — b{x' , v)\ + |(t(x, v) — cr{x', v)\ < C\x — x'\. 

2. • / and $ are bounded, 

• for all (x, y, z) G M'^ X M X R.'^, f{x, y, z, •) is continuous in v £ U, 

• for all X, x' G R'^, y, y' G E, z, z' G M"' and v ^U, 

|$(x) - ^{x')\ + |/(x,y,z,f) - f{x',y',z',v)\ < C{\x - x'\ + \y - y'\ + \z - z'\). 

Under the assumptions 1.-2., the system ^ has an unique solution (X*'^''", y*'^>"^ j^t,x,u^ ^ 

S^it,T;R'^) X 5^(t,r;M) x nu{t,T;R'^) x A^^^-^^ j.. j^d)^ g^^^^ 

J(t, X, u) := y^*'^'" 

is well defined for all {t,x) G [0, T] x M'^ and u G (see, for instance, ^j). We set 

V{t,x) = essinf„gi^^(t)J(t,x,it). 

Further it is known (see, e.g., [l], [2]) that the a priorily random field V{t,x) possesses a 
continuous, deterministic version (with which we identify it) and solves in viscosity sense 
the following Hamilton-Jacobi-Bellman equation: 

^V{t, x) + inf H{x, V{t, x),DV{t, x),D^V{t, x),v) = 0, (t, x) G [0, T] x M'=', 
at v£U (5) 

V{T,x) = $(x), X G M'^, 
with, for ah (x, y,p, ^, G M'' x M x M'^ x S"^ x [/, 

H{x,y,p,A,v) = i^^tr{{aa*){x,v)A) + b{x,v)p + f{x,y,pa{x,v),v)^ , 

where S"^ is the space of the symmetric matrices in R'^^'^, and DV and D^V represent, 
respectively, the gradient and the Hessian matrix of V. 

Further we consider the following assumption: 



For all (x, y) G X M, there exists a compact set A in X M°' X U, with 
A D { {a*{x,v)w,0,v)\v £U,weR'^ s.t. \a*{x,v)w\ <K} 

and such that the following set is convex: 

{{{^J:*){x,y,z,e,v),(3{x,y,z,d,vmz,e,v) G A} , 
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where, for all (x, y, z,9,v) e M"^ x M x M*^ x M"' x U, we have set 

/ a{x,v) \ ^ ^ ( b{x,v) \ 

J:{x,y,z,e,v) = I and (3{x,y, z,e,v) = I . 

\ z J V -f(x,y,z,v) J 

The main result of this paper can now be stated: 

Theorem 1 Under assumption (H), for all {t,x) S [0,T] x W^, there existe a reference 
stochastic system v and an admissible control u € Up{t) that is optimal for i.e. if 

Yt,x,u^ 2t,x,u^ ]^t,x,u^ ^ rp. j^d) X J., j^) X J.. X _y^2(^^ J.. ^/^g 

solution of (OP on z/, we /laue 

y^*'^'" = V{t,x) = essinf^^jj_{t,x,u). 

We prove this theorem in chapter [H It is included in Theorem [3j Chapter [3] prepares this 
proof by the introduction of an approximating control problem. 

3 An Approximating Control problem 

The purpose of this section is to study a sequence of stochastic control problems for which 
we can explicitly determine an optimal feedback control process and whose value functions 
converge to that of our original problem. For this end we have to approximate the coefficients 
of our original control problem by smooth coefficients. 

For an arbitrary dimension m > 1 we let : R"*— > R be a non-negative smooth function 
on the Euclidean space R™" such that its support is included in the unit ball of R™" and 
Jj^m if {^) d^, = 1. For Lipschitz functions / : R"^ ^ R we set 

Then we can easily show that 

\l5{0-l{0\<Ci5, \l5{0-h'm<Ci\5-5'\, foralUGR'", (5,5'>0, (6) 

where C/ denotes the Lipschitz constant of /. 

For each 5 E (0, 1] we denote by bs,crs, fs and the mollifications of the functions b, a, f 
and respectively, introduced in Section [51 with I = b {.,v) , a {.,v) , f {.,v) and ^ {■) ■ We 
emphasize that the estimate ([6]) with I = b{.,v) , a (., f ) , / (•, f) does not depend on v G U. 
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Let us now fix an arbitrary 6 G (0, 1] and consider the following Hamilton- Jacobi- 
Bellman equation 

-y{t,x) + mf H' (x,iV',DV',D^V'){t,x),v) =0, (t,x) G [0,r] xM^ 
at v€U \ / (^7) 

V^{T,x) = ^s{x), X G M^, 
with the Hamiltonian 

{x,y,p,A,v) = ^ {ti {{asas){x,v) + 6'^I^d)A) +bs {x,v) p + fs {x,y,pas {x,v) ,v) , 

for (x, y,p, A,v) G M'^ x M x M"' x S"' x [/. Since the Hamiltonian is smooth and (asCTg) {x, v) + 
S'^I^d is strictly elliptic, we can conclude that the unique bounded continuous viscosity 
solution of the above equation belongs to C^'^([0, T] x W^). For this we can apply the 
regularity results by Krylov [D] (see the Theorems 6.4.3 and 6.4.4 in [S]). This regularity 
properties of the solution and the compactness of the control state space U allow to find 
a measurable function : [0, TjxW^ such that, for all {t, x) G [0, T] x R'^, 

(x,(V\DV\D^V^)(t,x),v^(t,x)) = mfH^ ( x, (V\ DV\ D^V^)(t, x),' 
\ ) veil V 

Let us fix now an arbitrary initial datum {t, x) G [0, T] x and consider the stochastic 
equation 

/ dXl = hi (Xl 1.' (s, Xl)) ds + <Jj (Xl v' dW, + SdB„ . £ [t, T], 

Since the coefficients bs [x',v^ {s,x')) and as [x',v^ {s,x')^ are measurable and bounded in 
(s,x') and the matrix {(Jscr^) [x',v^{s,x')) +5'^I^d is strictly elliptic, uniformly with respect 
to (s, x') G [t, T] x M*^, we get from Theorem 1 of Section 2.6 in [lOj the existence of a weak 
solution, i.e., there exists some reference stochastic system {Q.^ ^!F^ ,B^) and an 
F'^-adapted continuous process = such that, P'^-a.s., 

r dXl = bs (Xf , {s, Xf )) ds + as (Xf , (s, Xf )) dW^ + 5dBl s G % T], 
I Xl = X. 

For an arbitrarily given admissible control u G Ui^s (t) , let X'^'" denote the unique F'^-adapted 
continuous solution of the equation 

dXf'" = bs (xf'", n,) dt + as (xf'", n,) dt^,^ + ddB^ s G [t, T], 
Xf " = X. 
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We associate the backward equation 

' dy/'" = y/'", zf'", us)ds + z's^'^dw^ + c/f'"di?f + dMf-", ^ g [t, r], 

g M'^s{t,T;R'^) is orthogonal to l^*^ and to B^. 

In analogy to our original stochastic control problem we define the cost functionals for our 
approximating control problem with the help of the solution of ([9]) : 

We shall now identify the solution of the Hamilton-Jacobi-Bellman equation ([7]) as the 
value function of our approximating control problem and give an estimate of the distance 
between the value function and that of our original control problem: 

Proposition 2 1) Under our standard assumptions we have 

J\u') = V\t,x) = esstnf^^u^^^,)j\u), 

where uf := v^{s,Xg), s G [0,T], is an admissible control from U ,^6 (t). 

2) Again under our standard assumptions, there is some constant C only depending on the 
Lipschitz constants of the functions cr, b, f and ^ such that, 

\V\t,x) - V{t,x)\ < C(5^/^ for all {t,x) G [0,r] x R'^ and for all 6 > 0. 

Moreover, again for some constant C which only depends on the Lipschitz constants and 
the bounds of the functions a, b, f and $ but is independent of 6 > 0, the following holds 
true for all t, t' G [0, T] and x G M''; 

\V\t,x)\ + \DV\t,x)\ < C, 

\V^{t,x)-V^{t',x)\ < C{l + \x\)\t-t'\. 

Proof: 1) As it is well known that V^{t,x) = essinf^g^^ ^(j) J'^(m) (see, e.g., [T]) it only 
remains to show that J^{u^) = V^{t,x). For this end we observe that from the uniqueness 
of the solution of the controlled forward equation with control process it follows that 
XS,u' = x^. Moreover, let 

y/ = V'{s,X',), Zf = DV'{s,X',)asiXtui), = 6DV\s,X',), s G [t,T], 

and notice that the triplet {Y\ Z\ U^) belongs to S^g {t, T; M) x {t, T; R'^) x H^, (t, T; R'^). 
Then we obtain from Ito's formula (recall that G C^'^([0, T] x R°')), combined with 



8 



the Hamilton-Jacobi-Bellman equation satisfied by and the definition of the feedback 
control v^{s, x'), that {Y\ Z\ U^) satisfies BSDE O for u = u . From the uniqueness of the 
solution of BSDEQ it then follows that (y^'"*, Z"^'"* , C/'^'"' ) = {Y\ Z\ U^) and M'''"' = 0. 
Thus, from the definition of we get, in particular, that 

y/'^' =y/ = y5(t,x). 

2) Let 5' G (0,T] and {t',x') G [0,T] x R'^. Working on the reference stochastic system 
we have introduced for our arbitrarily fixed 6 > and (t, x) G [0, T] x R"^ at the beginning 
of this section, we let X*^''*''^''" G 52,(t',r;]R^) denote the unique solution of the forward 



equation 



4' *' = x'. 

We extend this solution process onto the whole interval [0, T] by setting '* = x', for 
s < t'. Then, by putting 



<5,i 



we define a stochastic process in 7-^^^ (t', T; R) , and by applying Ito's formula to V^' (s, X 
we show that 

v&',t',x' TrS'/ v^',t',x',u\ r^5',t',x' nT/<5' / ^6' ,t' ,x' X f ,t' ,x' S\ 

C/f = 5'I)y'5'(s,xf Mf = 0, s G [t',T], 
is the unique solution of the BSDE 

^y&',t',x' ^ _j5',t',x',u^^^ ^ zf''''^'dW^ + C/f <ii?f + dMf s G [t',T], 

iVf^''*''^' G M2^(t',r;R'^) is orthogonal to and to . 
We want to compare the first component of the solution of (jllj) with that of the BSDE 

^5' ,t' ,X' ,U'^ _ f f yS' ,t' ,X' ^5',t',x',U^ yS',t',x',U^ $ 



(11) 



dy; = -fs. [XI , , z"s , uij ds 

y^''*''-''"^ = ci>,(x^.*''-'."^), 
j^5',t',x',u' G >I^i(t',r;R'^) is orthogonal to and to -B''. 
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For this we observe that from the Hamilton-Jacobi-Bellman equation with the classical 
solution V^' it follows that 

js'AAu^ < fs' (xf-*''-''-^y/'*''-',zf «f) , . € [t',T]. 

Then the Comparison Theorem for BSDEs yields y/'*''^' < y/'-*'.^^''"''^ g G [t',T], P-a.s., 
and, consequently, due to 1), 

V^'{t',x') - V\t,x) = y/'*''^' - y/'"' < y/'*'-^'-"' - p.a.s. 

On the other hand, SDE and BSDE standard estimates show that there is some generic 
constant C which depends only on the Lipschitz and the growth constants of the involved 
functions b{.,v),a{.,v), f{., .,v) and $(.) but neither on 6,6' G (0,1] nor on {t',x'),{t,x), 
such that, with the usual convention y/'*''^'-"' = y^f ^ ^S',t',x',u^ ^ 

and Mf = 0, for all s < t', 



E 



sup \Yf -Y^f 
se[o,T] 







<C[{6- 5'f + i?[sup,,[o,r] |xf - x's -'\^\Tf 

< C{6 - 5'f + C{1 + \x\^ + |xf )|i - i'l + C|a; - 

(Recall that iW^'"* = 0). Consequently, 

V^'{t',x') - V\t,x) = y/'*''"' - < y/'*''^''"' - y/'«' 

< C\5 - S'\ + C{1 + \x\ + \x'\)\t' - + (^i^, _ ^/|^ 

and from the symmetry of the argument we get 

\V^'{t', x') - V^{t,x)\ < C\S - S'\ + C(l + \x\ + \x'\)\t' - + C\x - x'\. 

It follows that, in particular, 

\V\t,x') -V\t,x)\ < C\x-x'\, 
\V\t',x) - V\t,x)\ < C(l + \x\)\t' - t|V2, 

and 

\V^'{t,x) -V^{t,x)\ < C\S-6'\. 

Moreover, a standard estimate for the BSDE satisfied by (Y^,^\ Z^^""', U^'""', M^^""' ) yields 
the boundcdncss of , uniformly with respect to 6 > 0. 

Therefore, the function converges uniformly towards a function V € Cb([0,T] x M'^), as 
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6 tends to zero. Since the Hamiltonian H converges uniformly on compacts to the Hamil- 
tonian of the equation for V it follows from the stability principle for viscosity solutions 
that y is a viscosity solution of the same equation as V. Thus, from the uniqueness of the 
viscosity solution within the class of continuous function with at most polynomial growth 



\V^it,x) - V{t,x)\ < C6, for all 6 G (0,1] and {t,x) G [0,r] x R'^. • 

4 Convergence of the Approximating Control Problems 

After we have shown that the value function of the approximating problem converges to 
the value function of the initial problem, we will prove in this section that there exists a 
sequence of approximating stochastic controlled systems {X^" , Y^" , Z^" , u^" ) that converges 
in law to some controlled system, provided that the couple {Z^",u^") is interpreted as a 
relaxed control. Then, under some additional convexity condition, we shall find on a suit- 
able reference stochastic system some admissible control - now in the strong sense-, that is 
optimal for the initial problem ([2]). 

We begin this section with the introduction of this additional assumption, then we prove 
the main result of existence of an optimal control for ^ and after we discuss the additional 
assumption, in particular we compare it with that of [5]. 

For all A; > 0, let us denote by i?fe(0) the closed ball in M*^ of center and radius k. 
We also introduce the constant K=CM, where C > stands here for the constant of the 
estimates pO|) and M for an upper bound of {|(T(x,f)|, {x,v) x U}. 
We recah the definition of {T,,f3) : R'^ x R x R'^ x R'^ x U ^ ]^(rf+i)x(d+i) x R'i+i already 
introduced in chapter 2: 

For all (x, y, z,9,v) £ R'^ x R x R'^ x R'^ x U, we set 



we get that V and V coincide. Consequently, converges uniformly to V, as 6' 
from the above estimate of the distance between V^' and it then follows that 



0, and 




We also recall the assumption (H): 



{H){ 



For all {x, y) G M'^ x R, there exists a compact set ^4 in M'^ x M'^ x U, with 
Ad { {a*{x,v)w,0,v)\v eU,w eR'^ s.t. \a*{x,v)w\ <K} 
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Theorem 3 Suppose that assumption (H) holds and let {t,x) € [0, T] x M*^ and (5n)neN C 
(0, +CX3) with lim„^+oo = 0. Then there exists a reference stochastic system 



V = {n,T,P,¥,W), a quadruple {X,Y,Z,M) G S^{t,T;R'^) x 5?(t,T;M) x 5?(t,r;M'^) x 



Mp{t,T;W^), with M orthogonal to W , and an admissible control u G Up{t), such that 

1) There is a subsequence of {X^^ ,Y^")nen that converges in distribution to {X,Y), 

2) {X ,Y , Z , M) is the solution of the following system: 



^ Xt=X,YT = ^{Xt): 
3) For all {t, x) G [0, T] x M^, it holds that 

Yt = V{t,x) = essinf^(,y_f^t)J{t,x,u) , 

i.e. the admissible control u G Ujj{t) is optimal for jTgj) . 

Proof: We shall first introduce an auxiliary sequence of forward-systems, for which the 
convexity assumption (H) appears as the natural argument to guarantee the existence of 
a subsequence whose solutions converge in law to a couple (X, Y) associated to a control 
that is optimal for the original control problem. Then we will show that the initial sequence 
{X^" , Y^")neN and the auxiliary one have the same limits. 

1) For all n G N, let {X^,Y"') be the solution on u^" of the following controlled forward 
system: 



' dXI} = b {X2, uf") ds + a {X^, uf^) dW^", s G [t, T], 

< dYJ^ = -f {Xl\ y,", <a {X^, nf") , nf") ds + <ct {X^, nf") dW,'- s G [t, T], (13) 
Xf = x, Yr = Vit,x), 

with < = Z)y^"(s,Xf"). 



< 



dXs = b{Xs,Us)ds + a{Xs,Us)dWs, 

dYs = -f{Xs, Ys, Zs, Us)ds + ZsdWs + dMs, s G [t, T] 



(12) 



We can rewrite the system (p!3|) as follows: 




(14) 



with 



( 



s 



) 



r^ = {wy{Xl"),0,4") and W 



in 



( 



) 
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Since tf" = DV^" {s, X^") and DV^ is bounded by C, uniformly in 6 (Proposition [2]) , we 
can interpret G [t,T]) as a control with values in the compact set A of assumption 

m 

Now, in order to pass to the limit in n, we shall as usual embed the controls r" in the set of 
relaxed controls, i.e. consider r" as random variable with values in the space V of all Borel 
measures q on [0, T] x A, whose projection q{- x ^4) concides with the Lebesgue measure. 
For this, we identify the control process r" with the random measure 

q"'{uj, ds, da) = 5r^(^^){da)ds, (s, a) G [0, T] x A,uj £ Q. 

From the boundedness of y, z, 6, v),P{x, y, z, 9, v)) , (x, y, z,6,v) G M'^ x M x A} and 

the compactness of V with respect to the topology induced by the weak convergence of 
measures, we get the tightness of the laws of {x'^,q"'),n > 1, on C{[0,T];M'^ xR) x V. 
Therefore we can find a probability measure Q on C{[0,T];W^ x M) x V and extract a 
subsequence -still denoted by (x", 9")- that converges in law to the canonical process (x, q) 
on the space C([0, T];M'^ x M) x 1/ endowed with the measure Q. 

Now, by assumption (H) on the coefficients of system ([HI), we can apply the result of [5], 
that claims that there exists a stochastic reference system 1/ = {0., !F, P,¥,yV) enlarging 
(C([0,T];M'^ X M) X V;Q) and an F-adapted process f with values in A, such that the 
process x is a solution of 

dXs = f3{Xs,rs)ds + i:{Xs,rs)dWs, s£ [t,T], 
I X \ 



Xt 



V{t,x) 



and has the same law under P as under Q. Replacing T, and /3 by their definition and 



setting X 




and r = {Z,9,u), this system is equivalent to 



dXs = b{Xs,Us)ds + a{Xs,Us)dWs, 
dYs = -f{Xs,Ys, Zs,us)ds + ZsdWs + 9sdBs, s G [t, T] 
^ Xt = x, Yt = V{t,x). 

2) It follows from standard estimations that for some constant K > and for all n G N, 

i?[sup,g[,,r]|Xf"-X,"|2]<if5„, 
E[snp,^[t^T]\Ys'--Yr\^]<K5n. 

This implies that if some subsequence of {X^,Y^)n£N converges in law, the same holds 
true for (X^" , Y^" )n<=N, and the limits have same law. Further we deduce from (fTCj) and 



(15) 
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Proposition El that Ys = V{s,Xs) for all s G [t,T] P-a.s.. In particular Yr = ^{Xt) P-a.s. . 
Thus, if we set = // 9rdBr, then (M, W)s = // SrdiB, W)r = and {Y, Z, M) satisfies 

m- 

3) We have already seen that Yg = V{s,Xs) for all s € [t,T] P-a.s. On the other hand, 
it is well known that, for the unique bounded viscosity solution V of the Hamilton-Jacobi- 
Bellman equation 

V{t,x) = essinf„gi^_(()J(i,x,u), P-a.s. 
(see e.g. [1]). Thus assertion 3) of the theorem follows. • 

We state now a proposition that relays assumption (H) to some convexity assumptions 
concerning the parameters of the initial system Q. 



For all {x, y) G M"' x M, the set 

{{{aa*){x, v), {aa*){x, v)w, h{x, v), f{x,y, a* (x, v)w, v)) \v ^ U,w M.'^ s.t. \cr*{x, v)w\ 
is convex. 



Proposition 4 1) We suppose that the following assumption holds: 
{Hl)< 
Then (H) is satisfied. 

2) We suppose that f doesn't depend on z, i.e., for all {x,y,z,v) G x M x M'^ x [/, 
f{x,y,z,v) = f{x,y,0,v) := f{x,y,v). 

Moreover, we assume that the following assumption is satisfied: 



{H2) 

Then we have (H). 



For all {x,y) G M'' x M, the set 
{{{aa*){x,v),b{x,v), f{x,y,v))\v G U} is convex. 



Remark 5 For the case of classical stochastic control problems with f independent of (y, z), 
we find in {H2) the standard assumption which guaranties the existence of an optimal control 
on a suitable reference stochastic system (see l^). 

Proof: 1) Let us fix G M*^ x M. We will show that, under assumption (HI), there 

exists a set A C U such that 

cd{{{^^*){x,a*{x,v)w,0,v),(3{x,y,cr*{x,v)w,v)) \{v,w) eU xR"^ s.t. \a*{x,v)w\ < K} 

= {{{^J:*){x,y,z,d,v),p{x,y,z,e,v)) \{z,d,v) G A}, 
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(where, for any set E, coE stands for the convex hull of E) and that we can choose A 
compact. 

For this end, we consider an arbitrarily chosen probability measure /i on the set T = 

{{v,w) € [/ X M'^l \a*{x,v)w\ < K}. 

The first step consists in finding a triplet (z, 0, v) G M*^ x M'^ x [/ such that 

/p((SS*)(x, a*{x, v)w, 0, v),P{x, y, a* {x, v)w, v)fi{dv, dw) 
= {{^^*){x,y,z,9,v),/3{x,y,z,9,v)). 

Set ^{v,w) = {{aa*){x,v),{aa*){x,v)w,b{x,v), f{x,y,a*{x,v)'w,v)). As assumption (-ffl) 
is supposed to hold true, there exists a couple {v, w) in F such that 

^{v,w)fi{dv,dw) = ^{v,w). (17) 



r 



We set z = a*{x,v)'w. Now the explicit calculus of {T,'E*){x,y, a* {x,v)'w,0,v) shows that, 
for getting (fT6|) . it suffices to find ^ e M*^ such that 



a :- 



w*{aa*){x,v)wfj,{dv,dw) — iv* {aa*){x,v)w = \6\'^. (18) 
But Q is non negative, since it can also be written as 

((T*(x, v){w — id)) {cr*{x, v){'w — id))* fi{dv, dw) > 0. 

Consequently, such gM.'^ satisfying (fT8|) exists. Further let us rewrite (fTSj) as 

\a*{x,v)w\'^fi{dv,dw) = \z\^ + (19) 



a 



r 



r 



Since the support of fi is included in F, it follows that z and 6 belongs to Bk{0). 

Now we define B as the set of triplets {z, 9, v) for which there exist G M'^ and a probability 

measure /i on F such that 

(i) z = a*{x,v)'w, \z\ < K 

(ii) the relations pT|) and (fTHj) are satisfied. 
Consequently, 

cd{{{T,'E*){x,a*{x,v)'w,0,v), (3{x,y,a* {x,v)'w,0,v)) \{v,w) G F} 
= {((SS*)(x, y, z, 9, v),l3{x, y, z, 9, v)) \{z, 9, v) e B} . 

Le A be the closure of B. From the boundedneess of S (c i?x(0) x B^iO) x U) follows 
the compactness of A. Moreover, since {{T,T,*){x,y, ■,■,■), (3{x,y, ■)) is continuous, the 
conYex.ity of {{{T,'E*){x,y, z,9,v), P{x,y, z,9,v)) \{z,9,v) £ B} implies that of 
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{{{T.T.*){x,y,z,0,v),(3{x,y,z,9,v)) \{z,e,v) G A}. Finally, for all {v,w) e U x R"^ with 
\a*{x,v)ijd\ < K, {a*{x,v)iv,0,v) £ B C A (for /u = 6v^u,). 



2) As for 1), for all probability measure fi on F, we can find v G U such that 



(((Tcr*)(x, v), b{x, v), /(x, y, v)) fj.{dv, dw) = {{aa*){x, v),b{x, v), f{x, y, v)) 



We will show next that there exists it; € M such that 



{aa*){x,v)wfi{dv, dw) = {aa*){x,v)w. 
Indeed, since the matrix {aa*){x,v) is semidefinite positive, it can be written as 

{aa*){x,v) =TAT*, 

( \i \ 



(20) 



where T G such that TT* = T*T = I^a, and A 



G 



pdxd 



with 



V Xd J 



Ai > . . . > Ad > 0. 

For {ei, . . . , Crf} the canonical basis of M'^, we set fk = Te^, k G {1, . . . , d}. Remark that 
also {/i, . . . , fd} is an orthonormal basis of M^. 
Now let / G {0, . . . , d} be such that Ai > . . . > A; > = A;+i = 
matrix {aa*){x,v) is invertible and to get ([20|) . we just have to set 

1-1 



Xd- li I = d, the 



w = {{aa*){x,v)} J {aa*){x,v)wfj,{dv,dw). 
Else, for all r G {/ + 1, . . . , d}, we have 

{{aa*){x,v)fr, fr) = {Aer,er) = , 
where (•, •) stands for the scalar product in M"^. This implies that 

J^\a*{x,v)fr\'^fi{dv,dw) = j^{{aa*){x,v)frjr)l^{dv,dw) 

= {{!Ti^<^*){x,v)ll{dv,dw)) fr,fr) 
= {{(^(^*){x,v)fr,fr) 
= 0. 

In other words a*{x,v)fr = 0, /i-a.e., and 

{J {aa*){x,v)w^{dv,dw), fr) = J w*{aa*){x,v)frn{dv,dw) = ,1 + 1 < r < d 
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Hence J^^j^^^^-^{(ja*){x,v)w* ^{dv,dw) G span{/i, . . . , /;}, and the existence oi w ^ 
satisfying (pUj) follows. 

The end of the proof proceeds as for statement 1) : we chose some 6 E M*^ that satisfies 
(fT8|) . we set z = a*{x^v)w and prove that z and 9 necessarily belong to Bk{^)- Then we 
define A as for statement 1) . • 
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